Section: New Results

On the Existence of Strict Optimal Controls for Constrained, Controlled Markov Processes in Continuous-Time

Participant : François Dufour.

Closedness and convexity conditions are identified under which optimal controls in the class of strict controls exist for a large class of stochastic processes under infinite-horizon discounted, long-term average, first exit, finite-horizon and discretionary stopping criteria in the presence of hard and/or soft constraints. The results are more general than results obtained by Haussmann and Lepeltier for a controlled diffusion under a mixed optimal-stopping/finite-horizon/first-exit criterion. The approach taken in this work is to utilize equivalent linear programming formulations of the control problems which provides a unified LP formulation for the problems. The conditions of Haussmann and Lepeltier are shown to imply the sufficient conditions of this paper when the process is a controlled diffusion. Simpler conditions are also identified for Markov chains, simple Markov jump processes, diffusions with jumps, regime-switching diffusions and solutions to Levy stochastic differential equations.

These results have been obtained in collaboration with Richard Stockbridge, Department of Mathematical Sciences, University of Wisconsin Milwaukee, USA. It has been accepted for publication in Stochastics [14]